Imaging device, image processing method, and program thereof

ABSTRACT

An imaging device includes a display unit for displaying a video image being captured, an index operating unit for inputting an instruction for an index, and an index setting unit for setting as an index section, a section in the video image captured for a predetermined time period including a time point of a user&#39;s operation of inputting the instruction for the index, in response to one user&#39;s operation on the index operating unit while the video image is captured.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to an imaging device, an image processingmethod, and a program thereof.

2. Description of the Related Art

A personal computer (hereinafter, referred to as a PC) is typically usedfor editing video images captured by an imaging device such as a digitalvideo camera. A film-roll display is one of the methods for grasping anoutline of the video image at the time of editing it. The film-rolldisplay is a method in which a plurality of frame images is selectedfrom the recorded video image at a predetermined time interval and theframe images are arranged and displayed in time-series order asthumbnail images (see Japanese Unexamined Patent Application PublicationNos. 2007-134771 and 2008-166988, for example).

SUMMARY OF THE INVENTION

In many cases, however, the video images were edited by PCs after apassage of time from the day when the video images were captured.Accordingly, it took a long time to pick up the necessary parts from thevideo images and edit them, and the working efficiency was unfavorable.More, specifically, it was necessary for users to replay the videoimages from the beginning thereof so as to find the necessary parts andthen pick them up (edit them) since the users do not remember thecontents of the video images, which were captured before, clearly. Forexample, there is a case in which a user wants to determine whether ornot each part of a video image is necessary and delete the unnecessaryparts from the video image after a long time has passed since the videoimage was captured. In this case, it was necessary for the user toreplay the video image from the beginning thereof, take time to watchthe contents of the video image, and then determine which parts were tobe deleted. Particularly, when the recording time of the video image waslong, it was significantly inefficient and complicated to edit the videoimage.

From the view point of replaying the video images, there was a similarproblem. For example, when the recording time of a video image was long,and only a part of it was worth watching, it was difficult for a user tofind which section of the video image was to be watched as a priority,after the passage of time from the day when the video image had beencaptured. Therefore, it was necessary for the user to replay and watchthe video image from the beginning thereof. When there was no scene inthe thumbnail images, which the user wanted to watch, even if thefilm-roll display was used, it was necessary to replay the video imageand take time to watch the contents thereof. As described above, it wasinefficient to the user in finding the sections of the video image,which the user wanted to watch even at the time of replaying the videoimage.

In this regard, an index could be provided to an exciting scene in avideo image while it was being captured, and was conveniently used atthe time of editing and replaying the video image thereafter. However,even when the index was provided to a certain time point of the videoimage while the video image was being captured, it was difficult to findout the range of the necessary part before and after the index. As aresult, it was necessary for a user to watch the video image before andafter the time point to which the index was provided and determine therange of the necessary section. Furthermore, a plurality of operationswas necessary for providing the index not to a time point but to asection of the video image, and the operations were complicated for theuser.

It is desirable to provide an index not to a time point but to a sectionof a video image with simple operations while the video image iscaptured.

According to an embodiment of the present invention, there is providedan imaging device including: a display unit for displaying a video imagebeing captured; an index operating unit for inputting an instruction foran index; and an index setting unit for setting as an index section, asection in the video image captured for a predetermined time periodincluding a time point of a user's operation of inputting theinstruction for the index, in response to one user's operation on theindex operating unit while the video image is captured.

Here, the index operating unit may include a position detecting unit fordetecting a position in a display screen of the display unit, which anoperating body touched or approached. In addition, the user's operationmay include allowing the operating body to touch or approach the displayscreen.

The imaging device may further include an object recognition unit forrecognizing an object which appears in the video image. Here, theposition detecting unit may detect a position on the display screen,which was designated by the operating body while the video image wasbeing captured. In addition, the object recognition unit may recognizethe object which appears in the position on the display screen, whichwas designated by the operating body. Moreover, the index setting unitmay set as the index section, the section in the video image, in whichthe object recognized by the object recognition unit appears.

The imaging device may further include a deletion unit for deleting asection in the video image which is captured before the index section,when the section in the video image in which the object appears is setas the index section while the video image is captured.

The position detecting unit may detect a sliding method of the operatingbody on the display screen when the operating body slides on the displayscreen while the video image is captured. In addition, the index settingunit may set the index section in accordance with the sliding method.

The position detecting unit may detect the sliding direction of theoperating body. In addition, the index setting unit may set the indexsection in accordance with the sliding direction while using the timepoint at which the operating body slides on the display screen as areference.

The position detecting unit may detect the sliding length of theoperating body. In addition, the index setting unit may set the indexsection which employs as the start point, the time point preceding thetime point at which the operating body slides on the display screen bythe time decided in accordance with the sliding length.

The imaging device may further include: a recording unit for associatingthe index information representing the index section with the videoimage and recording the index information in a recording medium; and adisplay control unit for causing the display unit to display a recordconfirmation screen of the video image immediately after the instructionfor the completion of the recording of the video image, making acorrespondence relationship between a display object representing theindex section and a time axis representing the recording time of thevideo image based on the index information, and displaying the displayobject on the record confirmation screen. In addition, the positiondetecting unit may detect a user's operation on the display objectrepresenting the index section displayed on the record confirmationscreen. Moreover, the index setting unit may adjust the index section inresponse to the user's operation.

The imaging device may further include a deletion unit for deleting thesections other than the index section in the video image in response tothe user's operation on an icon displayed on the record confirmationscreen.

The imaging device may further include a display control unit for makinga correspondence relationship between the display object representingthe index section and the time axis representing the recording time ofthe video image and displaying the display object on a live-view screendisplayed on the display unit while the video image is captured.

According to another embodiment of the present invention, there isprovided an image processing method including the steps of: displaying avideo image being captured on a display unit while capturing the videoimage; and setting as an index section, a section in the video imagecaptured in a predetermined time period including the time point of auser's operation of inputting an instruction for an index, in responseto one user's operation on an index operating unit for inputting theinstruction for the index while the video image is captured.

In addition, according to still another embodiment of the presentinvention, there is provided a program for causing a computer to executethe steps of: displaying a video image being captured on a display unitwhile the video image is captured; and setting as an index section, asection in the video image captured in a predetermined time periodincluding the time point of a user's operation of inputting aninstruction for an index, in response to one user's operation on anindex operating unit for inputting the instruction for the index whilethe video image is captured.

With above-mentioned configuration, the video image being captured isdisplayed while it is captured, and a section in the video imagecaptured for a predetermined time period including the time point atwhich the user operates to input the instruction for the index is set asan index section in response to one user's operation on the indexoperating unit for inputting an instruction for the index while thevideo image is captured. As a result, it is possible to set the indexsection in response to one user's operation on the index operating unitwhile the time point at which the user inputs the instruction for theindex is used as a reference.

According to the embodiments of the present invention, it is possible toprovide an index not to a time point but to a section of a video imagewith simple operations while the video image is captured.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a perspective view illustrating an external configuration on afront side of an imaging device according to a first embodiment of theinvention;

FIG. 2 is a perspective view illustrating an external configuration on aback side of the imaging device according to the first embodiment of theinvention;

FIG. 3 is a block diagram illustrating a hardware configuration of theimaging device according to the first embodiment of the invention;

FIG. 4 is a block diagram illustrating a functional configuration of theimaging device according to the first embodiment of the invention;

FIG. 5 is a diagram illustrating a display example of a live-view screenaccording to the first embodiment of the invention;

FIGS. 6A to 6C are conceptual diagrams illustrating setting methods ofindex sections according to the first embodiment of the invention;

FIG. 7 is a diagram illustrating a display example of a recordconfirmation screen according to the first embodiment of the invention;

FIG. 8 is a diagram illustrating an adjustment example of the indexsection in the record confirmation screen according to the firstembodiment of the invention;

FIG. 9 is a diagram illustrating a modified example of the adjustment ofthe index section according to the first embodiment of the invention;

FIG. 10 is a diagram illustrating a modified example of the adjustmentof the index section according to the first embodiment of the invention;

FIG. 11A is a flowchart illustrating a processing method from the timeof capturing the video image to the time of completing the recordingwith the imaging device according to the first embodiment of theinvention;

FIG. 11B is a flowchart illustrating a processing method from the timeof capturing the video image to the time of completing the recordingwith the imaging device according to the first embodiment of theinvention;

FIG. 12 is a diagram illustrating a display example of a live-viewscreen according to a second embodiment of the invention;

FIG. 13 is a diagram illustrating a display example of the live-viewscreen according to the second embodiment of the invention;

FIG. 14 is a diagram illustrating a display example of the live-viewscreen according to the second embodiment of the invention;

FIG. 15 is a diagram illustrating a display example of a live-viewscreen according to a third embodiment of the invention;

FIG. 16 is a diagram illustrating a display example of the live-viewscreen according to the third embodiment of the invention;

FIG. 17 is a diagram illustrating a display example of a recordconfirmation screen according to the third embodiment of the invention;

FIG. 18 is a diagram illustrating a display example of the live-viewscreen according to the third embodiment of the invention; and

FIG. 19 is a diagram illustrating a relationship between a slidinglength and a time length of an added section according to the thirdembodiment of the invention.

DESCRIPTION OF THE PREFERRED EMBODIMENTS

Hereinafter, the description will be made of the preferred embodimentsof the present invention with reference to the accompanying drawings. Inthis regard, the components with identical reference numerals indicatethe items with substantially identical functional configurations, andthus further description will be omitted.

Furthermore, the description will be made in the following order:

1. First Embodiment (Setting of Index Section in Response to IndexInstruction)

2. Second Embodiment (Setting of Index Section Using Object Recognition)

3. Third Embodiment (Setting of Index Section in Response to User'sGesture)

4. Conclusion

1. FIRST EMBODIMENT Configuration of Imaging Device

First, the description will be made of the configuration of the imagingdevice according to the first embodiment of the invention with referenceto FIGS. 1 to 3. FIGS. 1 and 2 are perspective views illustrating theexternal configurations on the front and back sides of the imagingdevice 10 according to this embodiment of the invention, and FIG. 3 is ablock diagram illustrating a hardware configuration of the imagingdevice 10 according to this embodiment of the invention.

As shown in FIGS. 1 and 2, the imaging device 10 according to theembodiment of the invention is implemented as, for example, a digitalvideo camera, and has functions of capturing and recording video images.However, the application of the imaging device according to theembodiment of the invention is not limited to the video camera, and theimaging device can be applied to any electronic apparatuses which canrecord video images of objects sequentially captured such as a digitalstill camera having a video image capturing function, a mobile phone, aPDA (Personal Digital Assistant), a mobile movie/music player, a gameconsole, and the like.

A case 12 constituting the external package of the imaging device 10 haslonger dimensions in longitudinal (front and back) and height (upper andlower) directions than a width dimension in a right and left direction.In this specification, the terms “right” and “left” are used torepresent the right and the left of the imaging device 10 when it isseen from the back side thereof. In addition, the terms “front” and“back” are used to represent the side of an object and the side of animaging element in an optical axis direction of an imaging opticalsystem, respectively.

In an upper front portion of the case 12, a lens barrel 16 with animaging optical system 14 incorporated therein extends in the front andback direction, and the front portion of the lens barrel 16 is providedso as to project from the front face of the case 12. The rear end of thelens barrel 16 is provided with an imaging element 18 for capturing theimage of the object, which is guided by the imaging optical system 14(refer to FIG. 3).

As shown in FIG. 1, a display panel 20 is provided on the left sideportion of the case 12 so as to be openable and closable, andaccommodated in an accommodating concave portion 1202 when closed. Thedisplay panel 20 is one of the examples of a display unit for displayingimages captured by the imaging element 18, and can be constituted by anLCD (Liquid Crystal Display), an organic EL (Electro Luminescence)display, or the like. Furthermore, a bottom wall of the accommodatingconcave portion 1202 is provided with a speaker 22 for outputtingreplayed audio data (refer to FIG. 3).

As shown in FIG. 2, a grip belt 26 is provided to extend in the frontand back direction on the right side of the case 12. Furthermore, aright side portion of the case 12 is provided with an accommodatingportion 24 which detachably accommodates a disc shaped recording medium2 (refer to FIG. 3) for recording image data and audio data, and theaccommodating portion 24 is opened and closed by an opening/closingcover 2402. The disc shaped recording medium 2 is an optical disc suchas a Blu-ray Disc, a DVD (Digital Versatile Disc), a CD (Compact Disc),or the like. In addition to the above mentioned optical discs, therecording medium for recording the captured images may be anotherarbitrary removable disc such as a magneto-optical disc, a semiconductormemory such as a memory card 4 (refer to FIG. 3), or the like.Alternatively, the recording medium may be a built-in type recordingmedium such as a hard disc built into the imaging device 10.

In addition, the upper front portion of the case 12 is provided with amicrophone 28 for collecting sounds. The upper back portion of the case12 is provided with an electronic viewfinder 29 with a small-sizeddisplay device 2902 incorporated therein (refer to FIG. 3). Furthermore,a battery 25 is detachably provided on the back lower side of the case12.

Moreover, as shown in FIGS. 1 and 2, the imaging device 10 is providedwith a power switch 30A, a still image capturing button 30B, a zoomingswitch 30C, a mode shifting switch 30D, a video image capturing button30E, an index button 30F, and the like as operating units forinstructing the execution of the various functions regarding imaging.The video image capturing button 30E is an operating tool used by a userfor instructing the imaging device 10 to start and complete therecording of the captured video image, and it functions as both arecording start button and a recording completing button. The imagingdevice 10 starts the recording operation when the user presses the videoimage capturing button 30E after deciding the composition of an objectto be captured. In addition, the imaging device 10 stops the recordingoperation when the user presses the video image capturing button 30Eagain. In this regard, the recording operation means an operation forrecording image data (a video image constituted by a plurality offrames) sequentially captured by the imaging element 18, in a recordingmedium.

Next, an internal configuration of the imaging device 10 will bedescribed in detail with reference to FIG. 3. As shown in FIG. 3, theimaging device 10 includes the case 12, the imaging optical system 14,the lens barrel 16, the imaging element 18, the display panel 20, thespeaker 22, the microphone 28, and the various operating units 30A to30F as described above. Furthermore, the imaging device 10 includes atouch panel 40, a movie signal amplification circuit 100, an image dataprocessing unit 102, a microphone amplification circuit 104, an audiodata processing circuit 105, an output amplification circuit 106, arecord/replay circuit 108, a control circuit 110, a record/replaymechanism 112, a drive circuit 114, an interface circuit 116, a memorycard slot 118, a zoom driving unit 120, and a position measurement unit122.

The imaging optical system 14, the lens barrel 16, the imaging element18, and the zoom drive unit 120 function as an imaging unit 200 (referto FIG. 4) for imaging the object and outputting an imaging signal. Theimaging optical system 14 includes various lenses such as a focusinglens, a zoom lens, and the like and optical components such as anoptical filter for removing unnecessary waveforms, a diaphragm, and thelike. The light incident from the object is guided to the imagingelement 18 through respective optical components in the imaging opticalsystem 14. The imaging element 18 is constituted by a solid stateimaging element such as a CCD (Charge Coupled Device), a CMOS(Complementary Metal Oxide Semiconductor), or the like. This imagingelement 18 photoelectric-converts the light guided through the imagingoptical system 14, and outputs an imaging signal (an analog moviesignal) representing the captured object image.

The movie signal amplification circuit 100 and the image data processingunit 102 function as an image processing unit 210 (refer to FIG. 4) forprocessing the imaging signal generated by the imaging unit andgenerating image data. The imaging signal generated by the imagingelement 18 is amplified by the movie signal amplification circuit 100,and supplied to the image data processing unit 102. The image dataprocessing unit 102 generates image data (video image data or stillimage data) by performing a predetermined signal processing on thisimaging signal, and supplies the image data to the record/replay circuit108. The predetermined signal processing includes, for example, the CDS(Correlated Double Sampling) processing, the analog signal processingsuch as a gain processing by a PGA (Programmable Gain Amplifier) and thelike, the digital signal processing such as an A/D convertingprocessing, a gamma correction processing, a white balance processing,and the like.

In addition, the audio signal collected by the microphone 28 isamplified by the microphone amplification circuit 104, subjected to apredetermined signal processing by the audio data processing circuit105, and supplied to the record/replay circuit 108 as audio data.

The record/replay circuit 108 and the record/replay mechanism 112function as a record/replay unit 220 (refer to FIG. 4) for recordingvarious data such as image data, audio data, and the like in a recordingmedium and replay the various data recorded in the recording medium. Therecord/replay circuit 108 controls the record/replay mechanism 112 basedon the instruction of the control circuit 110, records data in a discshaped recording medium 2, and replays data from the disc shapedrecording medium 2.

For example, the record/replay circuit 108 follows the control of thecontrol circuit 110, and supplies the image data (video image data orstill image data) supplied from the image data processing unit 102 andthe audio data supplied from the audio data processing circuit 105 tothe record/replay mechanism 112. Then, the record/replay mechanism 112records the video image data, the still image data, and the audio datain a disc shaped recording medium 2.

Furthermore, the record/replay circuit 108 records the video imagedata/the still image data supplied from the image data processing unit102 and the audio data supplied from the audio data processing circuit105, in a memory card 4 mounted on the memory card slot 118 through theinterface circuit 116.

Moreover, the record/replay circuit 108 is controlled by the controlcircuit 110, supplies the video image data/the still image data suppliedfrom the image data processing unit 102 to the display panels 20 and2902 through the drive circuit 114, and causes them to display theimage.

In addition, the record/replay circuit 108 supplies the video imagedata/the still image data, which is supplied from the memory card 4through the interface circuit 116, to the display panels 20 and 2902through the drive circuit 114, and causes the display panels to displaythe images. Furthermore, the record/replay circuit 108 supplies theaudio data, which is supplied from the memory card 4 through theinterface circuit 116, to the speaker 22 through the outputamplification circuit 106, and causes the speaker 22 to output thesound.

Moreover, the record/replay circuit 108 supplies the video image data orthe still image data, which is replayed from the disc shaped recordingmedium 2 by the record/replay mechanism 112, to the display panels 20and 2902 through the drive circuit 114, and causes the display panels todisplay the image. Furthermore, the record/replay circuit 108 suppliesthe audio data, which is replayed from the disc shaped recording medium2 by the record/replay mechanism 112, to the speaker 22 through theoutput amplification circuit 106, and causes the speaker 22 to outputthe sound.

The display panels 20 and 2902 function as display units for displayingvarious image data (video image data or still image data) supplied asdescribed above. For example, the display panels 20 and 2902 display thevideo image (the live-view image) input from the record/replay circuit108 in real time while the image is captured. Accordingly, it ispossible for a user to perform imaging operations (such as a zoomingoperation, a recording start instruction, a recording completinginstruction, an index instruction input operation, and the like) whileviewing the video image being captured by the imaging device 10, andimage the desirable object in a desirable composition. In addition, whenthe video image recorded in the recording medium 2 or 4 is replayed bythe record/replay circuit 108, a display 130 displays the replayed imageinput from the record/replay circuit 108. With this configuration, it ispossible for the user to confirm the contents of the video imagerecorded in the recording medium 2 or 4.

The touch panel 40 functions as a position detecting unit for detectinga position on a display screen of the display panel 20, which anoperating body touches or approaches. The touch panel 40 is disposed soas to be overlapped on the display panel 20, and includes a sensor fordetecting a position on the display screen, which the operating bodytouches or approaches. With this configuration, the touch panel 40 candetect a position on the display screen, which was designated by theoperating body, and a movement track and a movement speed of theoperating body. The operating body used for the operation of the touchpanel 40 is, for example, a finger of the user, a stylus, a touch pen,or the like. The touch panel 40 detects as a coordinate, the position onthe display screen, which the operating body touches or approaches, andthe coordinate detected by the touch panel 40 is transferred to thecontrol circuit 110 to be subjected to a predetermined processing.

An arbitrary kind of touch panel such as a pressure sensitive touchpanel, an electrostatic touch panel, or an optical touch panel can beused as the touch panel. The pressure sensitive touch panel detects avariation in pressure when the panel is pressed by the operating body.The electrostatic touch panel detects an electrical signal through theelectrostatic caused when the operating body touches the panel. Theoptical touch panel is provided with an optical sensor on the outerframe of the display panel, which generally detects the position and themoving direction of the operating body touching the panel. There isanother type of optical sensor such as an in-cell optical touch panel.The in-cell optical touch panel includes a display panel with an opticalsensor array mounted thereon, and the optical sensor array detects theposition and the movement track of the operating body which touches orapproaches the display panel.

In addition, a contact type touch panel which detects a contact of theoperating body (for example, the above-mentioned pressure sensitive orelectrostatic touch panel) is generally used as a touch panel 40. A usercan perform the various operations on the imaging device 10 by pressingthe screen of the touch panel 40 with a finger, a stylus, or the like,and moving the finger or the stylus pressing the screen.

In this regard, there is also a non-contact type touch panel which canrecognize the operating body which approaches the touch panel, even ifthe operating body is not in direct contact with the touch panel. Thisnon-contact type touch panel can be implemented by the above-mentionedoptical touch panel. Hereinafter, although the description will be madeof the example of the contact type touch panel 40 for detecting acontact position of the operating body (for example, a finger) forconciseness, the position detecting unit according to the embodiment ofthe invention can be implemented by a non-contact type touch panel, orother screen position detecting devices.

The control circuit 110 functions as a control unit 230 (refer to FIG.4) for controlling each part of the imaging device 10. The controlcircuit 110 includes, for example, a CPU (Central Processing Unit), anEEPROM (Electrically Erasable Programmable ROM), a ROM (Read OnlyMemory), and a RAM (Random Access Memory). The ROM in the controlcircuit 110 stores a program for executing the various controlprocessings of the control circuit 110. The CPU operates based on theprogram, and executes a computation and the control processing necessaryfor the above-mentioned various controls while using the RAM. Thisprogram can be stored in advance in a recording medium (for example, theROM) built in the imaging device 10. Furthermore, the program may bestored in a removable recording medium and provided to the imagingdevice 10, or may be downloaded to the imaging device 10 through anetwork such as the LAN and Internet.

The description will be made of an example of control by the controlcircuit 110 hereinafter. The control circuit 110 turns on and off thepower source of the imaging device 10 based on the user's operation onthe power switch 30A.

In addition, the control circuit 110 instructs the image data processingunit 102 and the record/replay circuit 108, based on the user'soperation on the still image capturing button 30B, to supply the stillimage data, which is supplied from the image data processing unit 102,to the record/replay mechanism 112 through the record/replay circuit108. Then, the control circuit 110 causes the disc shaped recordingmedium 2 to record the still image data. As described above, the stillimage capturing button 30B functions as a so-called shutter button forcapturing and recording the still image.

The control circuit 110 instructs the zoom driving unit 120, based onthe user's operation on the zooming switch 30C, to cause the movablelens (not shown) of the imaging optical system 14 to move and thereby tochange the zoom rate of the imaging optical system 14.

In addition, the control circuit 110 instructs the image data processingunit 102, based on the operation on the mode shifting switch 30D, toshift between a video image capturing mode for generating the videoimage data by the image data processing unit 102 and a still imagecapturing mode for generating the still image data by the image dataprocessing unit 102. In this regard, the video image data generated bythe image data processing unit 102 is recorded in the disc shapedrecording medium 2 or the memory card 4 through the record/replaycircuit 108 in the video image capturing mode, and the still image datagenerated by the image data processing unit 102 is recorded in the discshaped recording medium 2 or the memory card 4 through the record/replaycircuit 108 in the still image capturing mode. Moreover, the controlcircuit 110 can shift a mode to a replay mode for replaying the recordedimages, in addition to the above-mentioned two imaging modes.

In addition, the control circuit 110 starts and completes the recordingof the video image data by the imaging device 10 based on a user's firstoperation on the video image capturing button 30E. That is, the controlcircuit 110 instructs, based on the user's operation (an instruction forstarting the recording of the video image) on the video image capturingbutton 30E, the image data processing unit 102 and the record/replaycircuit 108 to supply the video image data, which is supplied from theimage data processing unit 102, to the record/replay mechanism 112through the record/replay circuit 108 and thereby to start the operationfor recording the video image data in the disc shaped recording medium 2(to start the recording operation). Furthermore, the control circuit 110stops the recording operation (to complete the recording operation)based on a user's second operation (an instruction for completing therecording of the video image) on the video image capturing button 30E.As described above, the video image capturing button 30E functions as anoperating member (an operating unit for starting and completing therecording operation) for a user to instruct the imaging device 10 tostart and complete the recording of the video image. In the imagingdevice 10 according to the embodiment of the present invention, a singleoperating member (the video image capturing button 30E) functions asboth the operating unit for starting the recording operation and theoperating unit for completing the recording operation. However, thesetwo operating units may be implemented by two different operatingmembers.

Moreover, the control circuit 110 sets an index section in the videoimage based on the user's operation (an instruction for an index) on theindex button 30F during the recording period from the instruction forthe start of the recording operation to the instruction for thecompletion of the recording operation. Then, the control circuit 110generates index information representing the set index section, andassociates and records the index information with the video image data.The index button 30F functions as an operating member (an indexoperating unit) for inputting the instruction for the index by the user.

The index information is time information representing a predeterminedtime period including an arbitrary time point which is designated by theuser while the video image is captured and recorded (during therecording time period). For example, a user presses the index button 30Fin an exciting scene (for example, a scene of a home run in a baseballgame) or a favorite scene (for example, a scene of a smiling child)while the video image is captured, and inputs the instruction for theindex. The imaging device 10 sets as the index section, a section of thevideo image captured in the predetermined time period including a timepoint of inputting the instruction for the index, and records the indexinformation thereof. The index operating unit may be implemented by adedicated physical operating tool such as the index button 30F, or maybe implemented by a GUI (Graphical User Interface) component displayedon the display screen of the display panel 20.

The position measurement unit 122 has functions of measuring a currentposition of the imaging device 10 and generating imaging positioninformation which represents a position where the video image iscaptured. The position measurement unit 122 includes, for example, a GPS(Global Positioning System) sensor, an angular velocity sensor, anacceleration sensor, a magnetic sensor, and the like. The positionmeasurement unit 122 measures a position (a longitude, a latitude, orthe like) and a posture of the imaging device at the time of capturingthe video image while using these various sensors, and thus generatesthe imaging position information representing the imaging position atthe time of capturing the video image.

For example, the GPS sensor measures a current position (a longitude anda latitude) of the imaging device 10 by receiving radio waves from aplurality of GPS satellites and calculating distances from each of theGPS satellites. The angular velocity sensor and the acceleration sensorrespectively detect the angular velocity and the acceleration when theimaging device 10 moves while the video image is captured. The magneticsensor detects the direction of the imaging device 10 by detecting amagnetic field around the imaging device 10. The position measurementunit 122 acquires the position of the imaging device 10 (that is, theimaging position) at the time of capturing the video image by analyzingthe measurement data such as the current position of the imaging device10 detected in the above-mentioned manner, the angular velocity, theacceleration, the variation in the Earth's magnetic field, and generatesthe imaging position information representing the imaging position.

The control circuit 110 controls the record/replay circuit 108 and thelike to associate the imaging position information generated by theposition measurement unit 122 with a frame in the video image capturedat the imaging position and stores the imaging position information in arecording medium. For example, the position measurement unit 122measures the imaging position at a predetermined time interval (forexample, every few seconds or every few minutes) while the video imageis captured (during the recording time period), and generates theimaging position information representing the imaging position. Thisimaging position information is associated with the frame positioninformation of the video image, and stored in a recording medium such asa memory. The frame position information represents the position of eachframe composing the video image, and includes a time of imaging, a timecode, a number of frames from the beginning frame of the video image, ora time from the beginning of the video image, for example.

In addition, the control circuit 110 controls the record/replaymechanism 112, the record/replay circuit 108, the drive circuit 114, andthe like to generate a plurality of thumbnail images from the videoimage captured during the recording time period. The control circuit 110causes the display panel 20 to display the record confirmation screenincluding a display object representing the above-mentioned indexsection and the thumbnail images immediately after capturing the videoimage (that is, immediately after the instruction for the completion ofthe recording operation). This record confirmation screen is an autoreview screen (Rec_Review screen) for confirming the index section setin the recorded video image immediately after the completion of therecording of the video image, and the detailed description thereof willbe made later.

[Functional Configuration of Imaging Device]

Next, the description will be made of the functional configuration ofthe imaging device 10 according to the embodiment of the invention withreference to FIG. 4. FIG. 4 is a block diagram illustrating thefunctional configuration of the imaging device 10 according to theembodiment of the invention.

As shown in FIG. 4, the imaging device 10 includes the imaging unit 200,the image processing unit 210, the record/replay unit 220, the controlunit 230, the display panel 20, the various operating units 30A to 30F,the touch panel 40 as another operating unit, and the positionmeasurement unit 122. The control unit 230 includes an imaging controlunit 232, a display control unit 234, an index setting unit 236, amemory 238, an object recognition unit 240, and a function control unit242. Each of the functional units of the imaging device 10 will beexplained in the following description.

The imaging unit 200 is constituted by a drive circuit including, forexample, the imaging optical system 14, the lens barrel 16, the imagingelement 18, the zoom driving unit 120, and the like which are shown inFIG. 3. The imaging unit 200 is controlled by the imaging control unit232, captures an optical image of the object by the imaging element 18,and outputs an imaging signal representing the image obtained bycapturing the optical image.

The image processing unit 210 includes, for example, the movie signalamplification circuit 100, the image data processing unit 102, and thelike shown in FIG. 3. The image processing unit 210 is controlled by theimaging control unit 232, performs a predetermined processing on theimaging signal, and thereby generates the video image constituted bydata of a plurality of images. The video image is constituted by thevideo image frames which are sequentially generated at a predeterminedtime interval (for example, 1/60 seconds).

The record/replay unit 220 includes, for example, the record/replaycircuit 108 and the record/replay mechanism 112 shown in FIG. 3, recordsvarious data in the disc shaped recording medium 2, and replays thevarious data from the disc shaped recording medium 2. For example, therecord/replay unit 220 is controlled by the imaging control unit 232,records the video image input from the image processing unit 210 in thedisc shaped recording medium 2, and replays the video image recorded inthe disc shaped recording medium 2. In addition, the record/replay unit220 records the thumbnail images generated from the video image by thedisplay control unit 234 in the disc shaped recording medium 2, andreplays the thumbnail images recorded in the disc shaped recordingmedium 2.

The control unit 230 includes, for example, the control circuit 110shown in FIG. 3, and controls each unit of the imaging device 10. Aprocessor of the control circuit 110 executes a computer program forimplementing each function which will be described later, and eachfunctional unit shown in FIG. 4 can be implemented.

The imaging control unit 232 controls the imaging operations of theimaging device 10. That is, the imaging control unit 232 controls theimaging unit 200, the image processing unit 210, and the record/replayunit 220 as described above in response to the user's operation on eachof the operating units 30A to 30E to cause the imaging unit 200, theimage processing unit 210, and the record/replay unit 220 to execute theimaging processing for the video image or the still image, the recordprocessing, and the replay processing. For example, when a user pressesthe video image capturing button 30E and inputs the instruction for thestart of the record operation, the imaging control unit 232 controls therecord/replay unit 220, and starts to record the video image generatedby the imaging unit 200 and the image processing unit 210 in the discshaped recording medium 2 (the starting operation of the recording).Meanwhile, when the user presses the video image capturing button 30Eagain and inputs the instruction for the completion of the recordingoperation, the imaging control unit 232 controls the record/replay unit220, and completes the recording of the video image (the completingoperation of the recording).

The imaging control unit 232 can shift the operation mode of the imagingdevice 10 to the video image capturing mode, the still image capturingmode, or the replay mode in response to the user's operation on the modeshifting switch 30D. In the video image capturing mode and the stillimage capturing mode, the imaging processing by the imaging unit 200 andthe image processing by the image processing unit 210 are continuouslyperformed, and the video image which is being captured and obtained bythe above processing (hereinafter, also referred to as a captured image)is displayed on the display panel 20 as a live-view screen. The userdetermines the composition of the object and a shutter chance whileviewing the live-view screen of the captured image, and inputs theinstruction for the recording of the video image or the still image tothe imaging device 10. In the video image capturing mode, the videoimage data which is captured and subjected to the image processingduring the recording time period is recorded in the disc shapedrecording medium 2, the recording time period being a period from theinstruction for the start of the recording to the instruction for thecompletion of the recording by the video image capturing button 30E. Inthe still image capturing mode, the still image data which is capturedand subjected to the image processing at the timing of a releaseinstruction in response to the release instruction is recorded in thedisc shaped recording medium 2, the release instruction being made whenthe user presses the still image capturing button 30B (a so-calledshutter button).

The display control unit 234 controls the display panel 20 to cause thedisplay panel 20 to display the various images and data. For example,the display control unit 234 causes the display panel 20 to display thelive-view screen of the captured image in real time while the videoimage is captured. The live-view screen is a screen for displaying thecaptured images which can be obtained by the imaging processing by theimaging unit 200 and the image processing by the image processing unit210. It is possible for the user to decide the composition of the objectand determine the timing for start and completion of the recording, thetiming for adding the index by viewing the live-view screen on thedisplay panel 20, and the like in real time.

In addition, the display control unit 234 causes the display panel 20 toautomatically display the record confirmation screen of the video imageimmediately after recording the video image. The record confirmationscreen is an auto review screen which is automatically displayed on thedisplay panel 20 of the imaging device 10 immediately after thecompletion of the recording of the video image (that is, immediatelyafter the instruction for the completion of the recording operation isinput). This record confirmation screen includes the replayed image ofthe recorded video image, the thumbnail images of the video images, andthe like. The thumbnail images are the still images extracted from thevideo image recorded during the recording time period. This recordconfirmation screen has both the auto review function for showing theoutline of the recorded video image immediately after the recording andthe image operating function for executing predetermined functions (suchas a replay, a deletion, a rating, and the like) on the video imageimmediately after the recording. The display of such a recordconfirmation screen makes it possible for the user to confirm thecontents of the recorded video image immediately after the recording ofthe video image, thereby to edit the video image.

The index setting unit 236 sets the index section of the video imagewhile the video image is captured (during the recording time period) inresponse to one user's operation on the index operating unit. Then, theindex setting unit 236 generates index information representing the setindex section, associates the index information with the video image,and stores the associated index information in the memory 238. The indexinformation functions as an index to be added to the exciting scene orthe favorite scene in the video image.

As described above, the user operates the index operating unit in theexciting scene or the favorite scene during capturing of the video image(during the recording time period). This user's operation may bepressing of the index button 30F, tapping of the GUI component (forexample, an index icon 306 shown in FIG. 5) displayed on the live-viewscreen of the display panel 20, or the like. The user can input theinstruction for the index to the imaging device 10 with such anoperation. Then, the index setting unit 236 sets a predetermined timeperiod including the input time point of the instruction for the indexin response to the user's input of the instruction for the index, andsets as an index section, a section of the video image constituted by aplurality of frames captured in the above-mentioned predetermined timeperiod. Subsequently, the index setting unit 236 generates the indexinformation including the time information (for example, a timerepresenting the start point and the last point of the index section, atime code, or a time or a number of frames from the beginning of thevideo image) representing the set index section. Furthermore, the indexsetting unit 236 associates the generated index information with thevideo image, and stores the associated index information in a recordingmedium such as the memory 238.

As described above, the index setting unit 236 sets the index sectionconstituted not by a time point in the video image but by apredetermined section of the video image while the video image iscaptured in response to one user's operation on the index operatingunit, and stores the index information representing the index section.As a result, it is possible to add an index to the section in the videoimage corresponding to the time point designated by the user while usingthe arbitrary time point designated by the user as a reference.Accordingly, it is possible to add to the video image being captured, anindex for specifying the exciting scene or the favorite scene, andthereby to make the scene designated by the user while the video imageis captured be identifiable as a special scene. The index informationgenerated while the video image is captured in this manner is useful asan index at the time of replaying or editing the video image later.

In addition, the index setting unit 236 can change the time or theposition of the index section to be set in response to the user'soperation on the display screen, which is detected by the touch panel40. For example, when the user's finger slides on the display screen ofthe display panel 20 while the video image is captured, the touch panel40 detects the sliding method (for example, the sliding length or thesliding direction). Then, the index setting unit 236 sets the indexsection in accordance with the sliding method detected by the touchpanel 40. In addition, the sliding direction is a direction in which theoperating body slides on the display screen, and the sliding length is alength by which the operating body slides on the display screen.

Specifically, the index setting unit 236 sets the index section inaccordance with the sliding direction by the operating body. Forexample, when the operating body slid on the display screen in a firstdirection (for example, a right direction or an upper direction), theindex setting unit 236 sets a section of the frames, which are capturedduring the predetermined time period after the time point at which theoperating body slid on the display screen, as the index section. On thecontrary, when the operating body slid on the display screen in a seconddirection (for example, a left direction or a lower direction), theindex setting unit 236 sets as the index section, a section of theframes which are captured during the predetermined time period beforethe time point at which the operating body slid on the display screen.

Moreover, the index setting unit 236 sets the index section inaccordance with the sliding length of the operating body. For example,the index setting unit 236 decides the time length of the index sectionin accordance with the sliding length of the operating body. Inaddition, the index setting unit 236 decides the time corresponding tothe sliding length of the operating body, sets as a start point, thetime point preceding the time point at which the operating body slideson the display screen by the above-mentioned time, and sets as the indexsection, the section of the video image captured after the start point.

As described above, the user can easily designate the position and thetime length of the desirable index section by the direction or thelength of sliding on the display screen. The method for setting theindex section in accordance with the sliding on the display screen bythe user will be described later in detail.

The object recognition unit 240 analyzes the video image being captured,and thereby recognizes an object 340 being displayed on the live-viewscreen 300 of the video image, that is, the object 340 included in acaptured image 302 being currently captured. Here, the object is anarbitrary object included in the captured image which is captured by theimaging device 10, and may be an arbitrary thing such as a person, ananimal, a plant, a vehicle, a building. For example, when the userimages a dog with the imaging device 10, the dog is the object. Anarbitrary object recognition technique in the related art can beemployed as a method in which the object recognition unit 240 recognizesthe object.

The object recognition unit 240 recognizes the object 340 beingdisplayed in a position on the display screen, which is designated bythe user, while the video image is captured (refer to FIG. 12). Morespecifically, if the user designates an arbitrary position on thelive-view screen 300 using the operating body while the video image iscaptured, the touch panel 40 detects the position on the live-viewscreen 300, which is designated by the operating body. Such a user'sdesignating operation with respect to the live-view screen 300corresponds to the instruction for the index. The object recognitionunit 240 recognizes the object 340 appearing in the designated positionon the live-view screen 300 in response to such an instruction for theindex, and specifies the section of the video image constituted by aplurality of frames in which the object 340 appears. The index settingunit 236 sets as the index section, the section of the video imageconstituted by the plurality of frames in which the object recognized bythe object recognition unit 240 appears. By using the object recognitionand setting the index section as described above, the user can add anindex to the section of the video image in which the desirable object340 appears, with a simple operation of designating the object 340 onthe live-view screen 300.

The description was made of the method for setting the index section bythe index setting unit 236 hitherto. The display control unit 234 causesthe display panel 20 to display the information representing the indexsection set by the index setting unit 236. For example, while the videoimage is captured, the display control unit 234 causes the display panel20 to display a display object 320 representing the index section setwhile the video image is captured, on the live-view screen 300 whilemaking a correspondence relationship between the display object 320 andthe time axis of the recording time of the video image (refer to FIG.5). Furthermore, the display control unit 234 may display a thumbnailimage 330 captured at an arbitrary point in the index section (forexample, at a time point of inputting the instruction for the index, orthe start or last point of the index section) on the live-view screen300. In this manner, the display control unit 234 displays the displayobject 320 representing the index section on the live-view screen 300while the video image is captured. As a result, the user can confirm inreal time the time length and the position of the index section setwhile the video image is captured. The description will be made laterregarding the display of the index section while the video image iscaptured (refer to FIG. 5).

In addition, the display control unit 234 causes the display panel 20 todisplay the record confirmation screen 400 immediately after thecompletion of the recording of the video image (refer to FIG. 7). Whenthe record confirmation screen 400 is displayed, the display controlunit 234 causes the display object 420, which represents the indexsection set while the video image is captured, to be displayed on therecord confirmation screen 400 while making a correspondencerelationship between the display object 420 and the time axis of therecording time of the video image. This display object 420 is displayedbased on the index information stored in the memory 238. In addition,the display control unit 234 may display on the record confirmationscreen 400, the thumbnail images 430 captured at an arbitrary point inthe index section (for example, at a time point of inputting theinstruction for the index, or the start or last point of the indexsection). By displaying the display object 420 indicating the indexsection on the record confirmation screen 400 after the completion ofthe recording, the user can confirm after the recording, the time lengthand the position of the index section which is added to the video imagewhile the video image is captured, and adjusts the index section on therecord confirmation screen 400. The description will be made laterregarding the display and the adjustment of the index section after thecompletion of the recording of the video image (refer to FIG. 8 and thelike).

In addition, when the display control unit 234 displays the thumbnailimages 330 and 430 on the live-view screen 300 or the recordconfirmation screen 400, the display control unit 234 generates athumbnail image as a representative of one or not less than two indexsections set in the video image based on the index information stored inthe memory 238. At this time, the display control unit 234 may specify aframe corresponding to an arbitrary point (for example, the start orlast point of the index section, or the time point of inputting theinstruction for the index) in the index section represented by the indexinformation, and extract the frame as a thumbnail image 330 or 430 whichis the representative of the index section.

The function control unit 242 controls the record/replay unit 220 andthe like, and executes predetermined functions with respect to therecorded video image. This function control unit 242 executes thepredetermined functions with respect to a section or whole section ofthe video image based on the user's operation on the touch panel 40. Thepredetermined functions are the arbitrary functions which can beexecuted with respect to the image data of the video image, and are thefunctions such as a deletion of at least a section of the video image, areplay, an addition of an evaluation value (that is, a rating), acreation of a play list, and the like. The function control unit 242 mayperform these predetermined functions with respect to the whole sectionof one recorded video image, or may perform these functions with respectto a section of the video image. As described above, the functioncontrol unit 242 functions as a deletion unit, a replay unit, a ratingunit, a play list creating unit, and the like.

The function control unit 242 executes predetermined functions withrespect to the video image recorded in the recording medium 2 inresponse to the user's operation on the record confirmation screen 400immediately after the completion of the recording. For example, there isa case in which a user designates a deletion icon 450C (refer to FIG. 7)from among one or not less than two functional icons 450 displayed onthe record confirmation screen 400 while the record confirmation screen400 is displayed. In this case, the touch panel 40 detects the user'soperation with respect to the deletion icon 450C displayed on the recordconfirmation screen 400. The function control unit 242 deletes thesections other than the index section in the video image recorded in therecording medium 2 in response to the user's operation on the deletionicon 450C. At this time, the function control unit 242 can specify theimage sections other than the index section in the video image based onthe index information in the memory 238. In this manner, the user canexecute the functions such as the deletion, the replay, the rating, andthe like with respect to the video image immediately after thecompletion of the recording by selecting a desirable functional icon inthe record confirmation screen 400 using the touch panel 40.

In addition, the function control unit 242 executes predeterminedfunctions with respect to the video image being captured and recorded inresponse to the user's operation on the live-view screen 300 beingcaptured. For example, when the video image was added with the indexsection while captured, the function control unit 242 automaticallydeletes the section of the video image, which was captured before theindex section in the video image recorded in the recording medium 2. Asa result, the imaging device 10 can automatically delete unnecessarysections of the video image before the index section only by the user'soperation of adding the index section to a necessary section of thevideo image while the video image is captured.

[Display Example of Live-View Screen]

Next, referring to FIG. 5, the description will be made of the displayexample of the live-view screen 300, which is displayed while the videoimage is captured, according to the embodiment of the present invention.FIG. 5 is a diagram illustrating the display example of the live-viewscreen 300 according to the embodiment of the present invention.

As shown in FIG. 5, the live-view screen 300 is displayed on the displayscreen of the display panel 20 while the video image is captured by theimaging device 10 (during the recording time period). The live-viewscreen 300 is a screen for displaying the image being currently captured(that is, the captured image 302) by the imaging device 10 in real time.The index icon 306 is displayed on the captured image 302 in thelive-view screen 300. The index icon 306 is a GUI button for adding anindex to the video image while the video image is captured, and has asimilar function as that of the above-mentioned physical index button30F. By tapping the index icon 306 on the live-view screen 300 at anarbitrary time point while the video image is captured, the user caninput the instruction for the index to the imaging device 10, and addthe index to the video image at the time point. In this regard, theindex icon 306 may be displayed or may not be displayed on the live-viewscreen 300 depending on the user's setting.

Moreover, a time bar 310, the display objects 320 which represent theindex section set while the video image is captured, and thumbnailimages 330 are displayed on the lower side of the live-view screen 300while overlapping on the captured image 302.

The time bar 310 is an example of the display object representing thetime axis of the recording time of the video image being captured. Thetime bar 310 shown in the example of FIG. 5 includes a slider bar with apoint shaped slider 312. The slider 312 in the time bar 310 moves fromthe left to the right in the screen with the passage of the recordingtime. The position of the slider 312 represents the recording time fromthe beginning of the video image to the captured image 302 beingcurrently captured (that is, the recording time from the start point ofthe recording to the current time). The user can know the currentrecording time of the video image being captured by checking theposition of the slider 312 in the time bar 310. In addition, the lengthof the time bar 310 may be constant to scroll-display the time bar 310such that the slider 312 representing the current time point istypically positioned in the center of the horizontal direction of thescreen. Alternatively, the length of the time bar 310 may be shortenedwith the passage of the recording time such that the whole part of thetime bar 310 is typically displayed in the live-view screen 300.

The display object 320 represents the index section set while the videoimage is captured. This display object 320 representing the indexsection (hereinafter, referred to as an index section object 320) isdisplayed while a correspondence relationship is made between the indexpart object 320 and the time bar 310 representing the time axis of therecording time of the video image. In the example of the FIG. 5, twoindex section objects 320A and 320B, which respectively represent thetwo index sections set while one video image is captured, are displayedon the upper side of the time bar 310. The relative position of theindex section object 320 with respect to the time bar 310 representswhich position on the time axis of the recording time the index sectionrepresented by the index section object 320 corresponds to. The user canknow the position and the time length of the index section set while thevideo image is captured by comparing the index section object 320 andthe time bar 310.

In addition, the index section object 320 includes the point 322representing the time point of the user's inputting of the instructionfor the index. This point 322 represents the time point of the user'soperation on the index button 30F or the index icon 306 to input theinstruction for the index while the video image is captured. It can beseen from the example of FIG. 5, in which two points 322A and 322B aredisplayed, that the instruction for the index was input twice while onevideo image was being captured. The user can know the time point atwhich the index was added to the video image by checking the point 322in the index section object 320. Furthermore, it can be seen from theexample of FIG. 5, in which the points 322A and 322B are disposed on theright ends of the index section objects 320A and 320B, that the timepoint of inputting the instruction for the index corresponds to the lastpoint of the index section.

The thumbnail image 330 is a still image as a representative of theindex section. In addition, the thumbnail image 330 is an image of aframe captured at an arbitrary time point in the index section of thevideo image (for example, the start point, the last point, or the timepoint of inputting the instruction for the index). In the example ofFIG. 5, the frames of the captured image 302 captured at time points(corresponding to the points 322) of inputting the instructions for theindex are used as thumbnail images 330. However, the frame captured atthe start or last point of the index section may be displayed as athumbnail image 330 of the index section. In addition, in the example ofFIG. 5, the thumbnail images 330A and 330B are pop-up displayed from thepoints 322A and 322B, respectively for the two index section objects320A and 320B. The user can confirm the representative image of the setindex section on the live-view screen 300 by checking such a thumbnailimage 330.

The description was made of the display example of the live-view screen300 hitherto with reference to FIG. 5. Next, the description will bemade of the operation of the imaging device 10 when the index is addedwhile the video image is captured by the imaging device 10.

As described above, the imaging device 10 is provided with the indexoperating unit for adding an index at an arbitrary time point in thevideo image such as an exciting scene or the desirable scene while thevideo image is captured. This index operating unit is a touch panel 40and the like which detects the user's operation on the index button 30Fand the index icon 306.

The user (the person who captures the image) of the imaging device 10operates the index operating unit and inputs the instruction for theindex to the imaging device 10 when the user feels that the scene beingcaptured is exciting. When the user inputs the instruction for theindex, the imaging device 10 sets the index section while using the timepoint at which the instruction for the index is input as a reference,and records the index information representing the index section in thememory 238. Moreover, the imaging device 10 displays the time bar 310,the index section object 320, and the thumbnail image 330 on thelive-view screen 300 displayed on the display panel 20 as shown in FIG.5. As described above, the time bar 310 represents the time axis of therecording time, the index section object 320 represents the set indexsection, and the thumbnail image 330 is a captured image 302 at the timepoint of inputting the instruction for the index.

As described above, in the imaging device 10 according to the embodimentof the invention, the index is added not to one frame captured at thetime point of inputting the instruction for the index but to a sectionconstituted by a plurality of frames captured for a predetermined timeperiod including the time point of inputting the instruction for theindex. This is because of the following reason. That is, it can beconsidered that in the case of capturing the video image, the scenesbefore and after a time point of inputting the instruction for the indexare also exciting even if the user inputs the instruction at a timepoint. For example, when a father wants to image his child's smilingusing the imaging device 10, he inputs the instruction for the indexafter his child smiled. However, the exciting scene in practice (thescene of the child's smiling) starts before the time point at which heinputs the instruction for the index. In such a case, it is preferableto add the index to the image captured before the time point ofinputting the instruction for the index.

Therefore, the imaging device 10 according to the embodiment of theinvention uses as a reference, the time point at which the user operatesthe index operating unit once to input the instruction for the index,sets a predetermined time period including the time point, andautomatically sets a section of the video image constituted by aplurality of frames captured in the predetermined time period as anindex section.

The time length of the index section is set to a predetermined time setin advance (for example, 5 seconds, 10 seconds, 30 seconds, or thelike). The imaging device 10 automatically sets the index time periodwith the predetermined time length while using the time point ofinputting the instruction for the index as a reference.

FIGS. 6A to 6C are conceptual diagrams illustrating the method forautomatically setting the index section by the imaging device 10according to the embodiment of the invention. FIGS. 6A to 6C showsexamples in which the time length of the index section is fixed to apredetermined time (10 seconds, for example).

In the example shown in FIG. 6A, the imaging device 10 sets indexsection to the 10 seconds before the time point of inputting theinstruction for the index. In this case, the last point of the indexsection corresponds to the time point of inputting the instruction forthe index. This setting method is useful for the case in which the scenealready captured before inputting the instruction for the index is theexciting scene.

Moreover, in the example shown in FIG. 6B, the imaging device 10 setsthe index section to the 10 seconds after the time point of inputtingthe instruction for the index. In this case, the start point of theindex section corresponds to the time point of inputting the instructionfor the index. This setting method is useful for the case in which theexciting scene is captured after inputting the instruction for theindex.

In the example shown in FIG. 6C, the imaging device 10 sets the indexsection to the 10 seconds before and after the time point of inputtingthe instruction for the index. In this case, the midpoint of the indexsection corresponds to the time point of inputting the instruction forthe index. This setting method is useful for the case in which theexciting scene appears before and after inputting the instruction forthe index, and the instruction for the index is input at a peak point inthe exciting scene.

As described above, the imaging device 10 according to the embodiment ofthe present invention handles the index representing the exciting scenein the video image not as a point but as a section. In addition, theimaging device 10 automatically sets the index section while using thetime point of inputting the instruction for the index as a reference.With this configuration, when the user operates the index operating unitonce, it is possible to automatically set the appropriate index sectionby the imaging device 10 while using the time point of the user'soperation as a reference. Accordingly, the user can use the imagingdevice 10 handily since it is not necessary to perform severaloperations for setting the index section. In addition, the user can setin advance the setting method of the index section shown in FIGS. 6A to6C and the time length of the index section for the imaging device 10.

Furthermore, the index section object 320 indicating the index sectionset in the above-mentioned manner is displayed on the live-view screen300 along with the time bar 310 and the thumbnail image 330 while thevideo image is captured. Thereafter, the imaging device 10 automaticallydeletes the time bar 310, the index section object 320, and thethumbnail image 330 from the live-view screen 300 when a predeterminedtime Ts1 elapses from the start of displaying these.

As described above, the imaging device 10 according to the embodiment ofthe invention displays the live-view screen 300 while the video image iscaptured, the live-view screen 300 including the index section object320 mapped to the time axis of the video image. Accordingly, the usercan confirm the time length and the position of the index section, whichis automatically set immediately after inputting the instruction for theindex, in real time.

[Display Example of Record Confirmation Screen]

Next, with reference to FIG. 7, the description will be made of thedisplay example of the record confirmation screen 400, which isdisplayed immediately after the completion of the recording of the videoimage, according to the embodiment of the present invention. FIG. 7 is adiagram illustrating the display example of the record confirmationscreen 400 according to the embodiment of the invention.

As shown in FIG. 7, the record confirmation screen 400 is automaticallydisplayed on the display screen of the display panel 20 immediatelyafter the completion of the recording of the video image by the imagingdevice 10 (immediately after inputting the instruction for thecompletion of the recording). That is, when the user presses the recordcompletion button (the video image capturing button 30E) and completescapturing and recording the video image, the imaging device 10 displaysthe record confirmation screen 400 on the display panel 20.

The record confirmation screen 400 is an auto review screen which isautomatically displayed on the display panel 20 of the imaging device 10immediately after the completion of recording the video image. Here, theexpression “immediately after inputting the instruction for thecompletion of the recording (immediately after the completion of therecording)” means “right after the elapse of processing time necessaryfor generating and displaying the record confirmation screen 400 fromthe time point at which the instruction for the completion of therecording is input”. For example, it is preferable that the recordconfirmation screen 400 is displayed in a few seconds (for example, onesecond) after the time point at which the instruction for the completionof the recording is input. The record confirmation screen 400automatically disappears when a predetermined time Ts2, which is setarbitrarily, is elapsed after the record confirmation screen 400 wasautomatically displayed immediately after the completion of therecording as long as the user does not operate the touch panel 40 toexecute predetermined functions, and the record confirmation screen 400shifts to a record wait screen. The transition of the screens displayedon the display panel 20 before and after the completion of the recordingcan be simply described as follows:

(1) The live-view screen 300 being imaged and recorded is displayedduring the time period of recording in the recording mode. On thislive-view screen 300, the above-mentioned index section object 320 andthe like are automatically displayed during the predetermined time Ts2in response to the input of the instruction for the index. Thereafter,the index section object 320 and the like are not shown on the live-viewscreen 300.

(2) The record confirmation screen 400 is automatically displayedimmediately after the instruction for the completion of the recording isinput during the recording time period and the recording is completed.Then, when the user does not operate the record confirmation screen 400,the record confirmation screen 400 is automatically deleted after thepredetermined time Ts2 elapses from the start of the display of therecord confirmation screen 400.

(3) The record wait screen (not shown) which is a live-view screen beingimaged by the imaging device 10 is displayed in the record wait mode (anon-recording time period) after the record confirmation screen 400 wasdeleted.

Hereinafter, the detailed description will be made of the contents ofthe record confirmation screen 400 with reference to FIG. 7. As shown inFIG. 7, a replayed image 402 of an arbitrary frame (for example, thelast image of the video image) extracted from the recorded video imageis displayed in the record confirmation screen 400.

Moreover, a time bar 410, a display object 420 indicating the indexsection, and the thumbnail image 430 are displayed on the lower side ofthe record confirmation screen 400 while overlapping on the replayedimage 402. The display object 420 is a display object (hereinafter,referred to as an index section object 420) indicating the all indexsections set while the video image is captured. The time bar 410, theindex section object 420, and the thumbnail images 430 displayed on therecord confirmation screen 400 shown in FIG. 7 have substantially thesame functional configurations as those of the time bar 310, the indexsection object 320, and the thumbnail images 330 displayed on thelive-view screen 300 shown in FIG. 5.

The time bar 410 is an example of the display object indicating the timeaxis of the recording time of the recorded video image. The time bar 410shown in FIG. 7 includes the slider bar with a point shaped slider 412.The position of the slider 412 represents the recording time from thebeginning of the video image to the replayed image 402 displayed on therecord confirmation screen 400 (that is, the recording time from thetime point of starting the recording to the current time). The user canknow the position of the replayed image 402 (the frame position) on thetime axis by checking the position of the slider 412 in the time bar410. In addition, when the user taps the slider 412 and slides theslider 412 in a horizontal direction in the time bar 410, the imagingdevice 10 detects the position of the slider 412, and displays thereplayed image 402 of a frame corresponding to the position of theslider 412 from among the video image on the record confirmation screen400. With this configuration, the user can confirm the replayed image402 at an arbitrary position on the time axis of the recorded videoimage. In this regard, the length of the time bar 410 may be constant toscroll-display the time bar 410 such that the slider 412 indicating thecurrent time point is typically disposed in the center of the screen inthe horizontal direction. Alternatively, the length of the time bar 410may be shortened with the passage of replaying time to typically displaythe whole part of the time bar 410 in the record confirmation screen400.

The index section object 420 is displayed while a correspondencerelationship is made between the index section object and the time bar410 indicating the time axis of the recording time of the video image.In the example shown in FIG. 7, two index section objects 420A and 420B,which respectively represent two index sections set while one videoimage is captured, are displayed on the upper side of the time bar 410.The relative position of the index section object 420 with respect tothe time bar 410 represents which position on the time axis of therecording time the index section represented by the index section object420 corresponds to. The user can know the position and the time lengthof the index section set while the video image is captured by comparingthe index section object 420 and the time bar 410.

In addition, the index section object 420 includes the point 422indicating the time point at which the user inputs the instruction forthe index. It can be seen from the example shown in FIG. 7, in which twopoints 422A and 422B are displayed, that the instruction for the indexwas input twice while one video image was being captured. The user canknow the time point at which the index is added to the video image bychecking the point 422 in the index section object 420.

The thumbnail image 430 is a still image as a representative of theindex section, and is a image of a frame captured at an arbitrary timepoint (for example, the start point, the last point, or the time pointof inputting the instruction for the index) in the index section of thevideo image. In the example shown in FIG. 7, the thumbnail images 430Aand 430B are pop-up displayed from the points 422A and 422B,respectively for the two index section objects 420A and 420B. The usercan confirm the representative image of the set index section on therecord confirmation screen 400 by checking such a thumbnail image 430.

As described above, the imaging device 10 according to the embodiment ofthe invention displays the record confirmation screen 400 including theindex section object 420 mapped to the time axis of the video imageimmediately after the completion of the recording of the video image.With this configuration, the user can confirm the time length and theposition of all the index sections set in the video image while thevideo image is captured, immediately after the completion of therecording of the video image when the user can still remember thecontents clearly. Furthermore, the user can confirm whether the indexsection automatically set by the imaging device 10 is acceptable, andadjusts the index section to the user's desirable section.

Hereinafter, the description will be made of the adjustment processingof the index section on the record confirmation screen 400 withreference to FIGS. 8 to 10. FIG. 8 is a diagram illustrating anadjustment example of the index section in the record confirmationscreen 400 according to the embodiment of the invention. FIGS. 9 and 10are modified examples of the adjustment of the index sections.

As shown in FIG. 8, flag marks 424 representing the start and the lastpoints of the index section are displayed on both ends of the indexsection object 420 displayed on the record confirmation screen 400.These flag marks 424 are the examples of the display objectsrepresenting the start and the last points of the index section. In theexample shown in FIG. 8, the flag marks 424A, 424B, 424C, and 424D, eachof which represent the start and the last points of respective indexsections, are displayed respectively on both ends of the two indexsection objects 420.

The user taps the flag mark 424 of the index section 420 correspondingto the index section, which the user wants to adjust, with its finger onthe record confirmation screen 400, and moves the flag mark 424 in thehorizontal direction while the flag mark 424 slides on the recordconfirmation screen 400. At this time, in accordance with the movementof the flag mark 424, the replayed image 402 on the record confirmationscreen 400 is changed to the image of the frame corresponding to theposition of the flag mark 424 on the time axis. As a result, the usercan accurately adjust the start point or the last point of the indexsection to the desirable position while checking the replayed image 402on the record confirmation screen 400.

In response to such a user's operation, the imaging device 10 adjuststhe start or the last point of the index section corresponding to theflag mark 424 operated by the user. The detailed description will bemade of the adjustment processing of the index section. The touch panel40 detects the flag mark 424 designated by the user's operation alongwith the moving amount and the moving direction thereof. The indexsetting unit 236 specifies the start or last point of the index sectioncorresponding to the detected flag mark 424, and adjusts the start orlast point to a position in accordance with the detected moving amountand the moving direction. In the example shown in FIG. 8, for example,when the user moves the flag mark 424B in the left direction, the lastpoint of the index section represented by the index section object 420is adjusted, and the time length of the index section is shortened.

In addition, FIG. 9 shows a modified example in which the flag marks 424of FIG. 8 are replaced with the thumbnail images 430. The thumbnailimages 430C and 430D are the images of the frames at the start point andthe last point of the index section corresponding to the index sectionobject 420. Moreover, FIG. 10 shows a modified example in which the flagmarks 424 of FIG. 8 are replaced with the GUI buttons 440. The user canadjust the index section in the same manner as in the case of the flagmark 424 by designating the thumbnail image 430 or the GUI button 440 onthe record confirmation screen 400 and moving it in a desirabledirection by a desirable moving amount.

As described above, the user can adjust the start point and the lastpoint of the index section, which is automatically set by the imagingdevice 10, to the start point and the last point of the scene, which theuser recognizes as the exciting scene, on the record confirmation screen400. Since the record confirmation screen 400 is displayed immediatelyafter the completion of the recording of the video image when the usercan still remember the contents clearly, the user can accurately adjustthe index section automatically set by the imaging device 10 to adesirable section. By accurately adjusting the index section immediatelyafter the recording in this manner, this adjustment functions as aprecise guide in editing the video image later.

This record confirmation screen 400 has all of (a) the auto reviewfunction for showing the user the index section set in the recordedvideo image immediately after the recording, (b) the adjustment functionfor adjusting the index section immediately after the recording, and (c)the editing function for executing the predetermined functions (thereplay, the deletion, the rating, and the like) with respect to at leasta part of the video image immediately after the recording. Both (a) theauto review function and (b) the adjustment function are implemented bythe index section object 420 and the like which is displayed in therecord confirmation screen 400 with the correspondence relationship withthe time axis of the recording time. In addition, (c) the editingfunction is implemented by the functional icons 450 (refer to FIGS. 7and 8) displayed on the record confirmation screen 400.

Here, referring again to FIGS. 7 and 8, the description will be made ofthe editing function of the video image using the functional icons 450on the record confirmation screen 400.

As shown in FIGS. 7 and 8, a plurality of functional icons 450 isdisplayed on the record confirmation screen 400. The functional icons450 are the GUI components which start to execute the predeterminedfunctions (for example, the replay, the rating, the deletion, and thelike) with respect to the recorded video image. In the example shown inFIG. 8, three functional icons 450, that is, a replay icon 450A, arating icon 450B, and a deletion icon 450C are displayed on the lightside of the record confirmation screen 400.

The replay icon 450A is a functional icon for replaying only the indexsection in the video image recorded in the recording medium 2. Therating icon 450B is a functional icon for adding an evaluation value tothe index section of the video image recorded in the recording medium 2.The deletion icon 450C is a functional icon for deleting the sectionsother than the index section in the video image recorded in therecording medium 2.

The user can execute the function corresponding to a selected functionalicon 450 with respect to the recorded video image by designating thefunctional icon 450 on the record confirmation screen 400. As describedabove, the touch panel 40 is provided on the display panel 20 of theimaging device 10, and the touch panel 40 detects the position (thescreen position) on the record confirmation screen 400, which wasdesignated by the user. It is possible to detect the operation ofselecting the functional icon 450 by using such a touch panel 40.

The imaging device 10 detects the existence of the user's operationusing the touch panel 40 while the record confirmation screen 400 isdisplayed. As a result, when the position detected by the touch panel 40while the record confirmation screen 400 is displayed corresponds to thedisplay position of any functional icon 450, it can be understood thatthe user selected the functional icon 450. in this case, the imagingdevice 10 determines that the instruction for the execution of thefunction corresponding to the functional icon 450 is input, and executesthe function corresponding to the functional icon 450 with respect tothe index section or the other section in the recorded video image.

For example, when the user designates (taps) the replay icon 450A whilethe record confirmation screen 400 is displayed, the imaging device 10extracts the image data of the index section from the video imagerecorded in the recording medium 2, based on the index information,replays the image data of the index section, and displays the replayedimage on the record confirmation screen 400. Accordingly, the user canwatch only the image of the index section, which is constituted by theexciting scene and the like, in the recorded video image. Thus, it ispossible to efficiently confirm the desirable section of the videoimage.

In addition, when the user designates (taps) the rating icon 450B whilethe record confirmation screen 400 is displayed, the imaging device 10adds the evaluation value designated by the user with respect to theindex section of the video image recorded in the recording medium 2. Forexample, the imaging device 10 may display the screen (not shown) forinputting the evaluation value in response to the designation of therating icon, and add the evaluation value designated in the input screento the video image. It is possible to add the evaluation value ofmultiple stages from level 1 to 5, for example. The information of theinput evaluation value is associated with the video image and stored inthe recording medium 2 and the like. Such information of the evaluationvalue is useful in replaying or editing the video image later.

Moreover, when the user designates (taps) the deletion icon 450C whilethe record confirmation screen 400 is displayed, the imaging device 10deletes the image data of the sections other than the index section inthe video image from the recording medium 2. In this case, the imagingdevice 10 may directly delete the image data of the sections other thanthe index section in the video image in response to the user's operationon the deletion icon 450C. Alternatively, the imaging device 10 maydisplay a confirmation dialogue (not shown) for confirming whether ornot to delete the image data, and delete the image data of the sectionsother than the index section of the video image when the user confirmsthe deletion of the image data. Furthermore, as a method for deletingthe video image, it is possible to exemplify some methods such as amethod in which the data of the video image is moved to the deletionlist, stored for a predetermined time period, and then deleted or amethod in which the data of the video image is not shown to the userwhile the data is actually stored in addition to a method in which thedata of the video image recorded in the recording medium 2 is completelydeleted.

As described above, it is possible to replay the index section, whichthe user wants to watch, in the recorded video image, and delete onlythe unnecessary sections other than the index section with a simpleuser's operation of tapping the functional icon 450 on the recordconfirmation screen 400. The user can replay only the index section, oreasily performs the editing operation such as a non-temporal recordingof only the index section in the recording medium 2 only by designatingthe functional icon 450 on the record confirmation screen 400. Inaddition, it is possible to record in the recording medium 2 only theimage data of the index section, which is a necessary part for the user,in the captured video image. Accordingly, it is possible to efficientlyrecord the necessary video image without wasting the recording area ofthe recording medium 2.

As described above, the description was made of the adjustment functionfor the index section and the editing function for the video image onthe record confirmation screen 400 with reference to FIGS. 7 to 10.According to the record confirmation screen 400 of the embodiment of thepresent invention, the user can adjust the index section set while theimage was being captured to a desirable section immediately after therecording of the video image when the user can clearly remember thecontents. Therefore, it is possible to add an index section with higheraccuracy to the video image. In addition, not an index point as a timepoint but an index section with a predetermined time length is added tothe video image. Therefore, when the video image is replayed and editedafter imaged, it is possible to efficiently replay and edit the videoimage in a short time while using the index section as a guide.

Moreover, according to the record confirmation screen 400, the user canreplay and edit the video image while using the index section as areference immediately after the recording of the video image when theuser can remember the contents clearly. In addition, the replayingoperation or the editing operation for the video image can beimplemented by a user's simple operation of designating the functionalicon 450 using the touch panel 40.

In selecting and editing the recorded video image later using theimaging device in related art, it was necessary to replay the videoimage from the beginning thereof and confirm the contents, and theseoperations were very complicated and inefficient. On the other hand,according to the record confirmation screen 400 of the embodiment of thepresent invention, it is possible to replay only the index section ofthe video image and perform the editing operation such as a deletion ofthe unnecessary sections other then the index section of the video imageimmediately after the recording when the user can still remember thecontents clearly. Accordingly, the replaying and editing operations areeasily implemented, and this is very convenient for the user. Inaddition, if the index section of the video image is partially ratedimmediately after the recording on the record confirmation screen 400,it can be used conveniently when the user replays and sees or edits thevideo image later.

[Processing Flow by Imaging Device]

Next, with reference to FIG. 11, the description will be made of theflow of imaging and image processing by the imaging device 10 accordingto the embodiment of the invention. FIG. 11 is a flow chart illustratingthe processing method at a time of imaging and completing the recordingby the imaging device 10 according to the embodiment of the invention.

As shown in FIG. 11A, when the user presses the record start button (thevideo image capturing button 30E) and inputs the instruction for thestart of the recording (S100), the imaging device 10 starts therecording operation of the video image (S102). In this recordingoperation of the video image, the imaging device 10 images the objectand records a plurality of frames obtained by the imaging in the discshaped recording medium 2. In addition, the imaging device 10 displaysthe live-view screen 300 (refer to FIG. 5) displaying the captured image302 being currently captured on the display panel 20.

The imaging device 10 detects whether or not one user's operation wasperformed with respect to the index operating unit (for example, theindex button 30F, or the touch panel 40), that is, whether or not theinstruction for the index was input by the user (S104). The user caninput the instruction for index to the imaging device 10 by pressing theindex button 30F or by tapping the index icon 306 on the live-viewscreen 300.

Then, the imaging device 10 set the section of the video image capturedfor the predetermined time period including the time point at which theinstruction for the index was input as the index section in response tothe input of the instruction for the index (S106). For example, as shownin FIGS. 6A to 6C, the imaging device 10 sets the index time period soas to include the time point of inputting the instruction for the index,and sets the index section constituted by a plurality of frames capturedduring the index time period.

Moreover, the imaging device 10 displays the index image representingthe index section set in S104 on the live-view screen 300 (S108). Theindex image includes the time bar 310 described with reference to FIG.5, the index section object 320, the thumbnail image 330, and the like.By display such an index image on the live-view screen 300, the user canconfirm the index section set in response to the operation for the indexin S104 while the video image is captured. Thereafter, when thedisplaying time of the index image on the live-view screen 300 reachesthe predetermined time Ts1 (S110), the imaging device 10 deletes theindex image from the live-view screen 300 (S112).

The recoding processing of the video image and the setting anddisplaying processing S104 to S112 of the index section are continueduntil the user inputs the instruction for the completion of therecording (S114). That is, the imaging device 10 detects whether or notthe instruction for the completion of the recording was input by theuser, that is, whether or not the record completion button (that is, thevideo image capturing button 30E) was pressed during the recordingperiod (S114). When the instruction for the completion of the recordingwas input, the imaging device 10 completes the recording operation(S116), and displays the record confirmation screen 400 (refer to FIG.7) regarding the recorded video image (S118). The record confirmationscreen 400 includes the time bar 410 described with reference to FIG. 7,the index section object 420, the thumbnail image 430, and the like. Theuser can confirm again all the index sections set during the recordingimmediately after the completion of the recording, using this recordconfirmation screen 400.

Furthermore, as shown in FIG. 11B, the imaging device 10 detects whetheror not the adjustment operation for the index section was performed bythe user while the record confirmation screen 400 is displayed (S120).As shown in FIG. 8, the user can adjust the start or last point of theindex section by operating the index section object 420 on the recordconfirmation screen 400. When the user's operation for adjusting theindex section was performed, the imaging device 10 adjusts the indexsection in response to the user's operation, updates the indexinformation in the memory 238, and displays the index section object 420corresponding to the adjusted index section on the record confirmationscreen 400 (S122).

In addition, when the user operates the functional icon 450 on therecord confirmation screen 400 while the record confirmation screen 400is displayed, the imaging device 10 edits the video image in response tothe user's operation on the functional icon 450 (S124). For example,when the replay icon 450A on the record confirmation screen 400 isdesignated, the imaging device 10 replays only the index section in therecorded video image. Moreover, when the deletion icon 450C on therecord confirmation screen 400 is designated, the imaging device 10deletes the sections other than the index section in the recorded videoimage.

Thereafter, when the display time of the record confirmation screen 400reaches the predetermined time Ts2 (S126) without performing theadjustment operation for the index section (S120) or the editingoperation for the video image (S124), the imaging device 10 associatesthe video image with the index information and stores them in therecording medium 2 (S128). When the video image was edited in S124, theimaging device 10 records the edited image (for example, the image dataof only the index section). In addition, when the index section wasadjusted in S122, the imaging device 10 records the index informationrepresenting the adjusted index section.

Furthermore, the imaging device 10 shifts to the record wait state,automatically deletes the record confirmation screen 400, and displaysthe record wait screen (S130). The record wait screen is a live-viewscreen displayed in the record wait mode, and the image being capturedby the imaging device 10 is displayed as the record wait screen. In thisregard, the imaging device 10 is not necessarily configured to shiftrecord wait mode after displaying the record confirmation screen 400 asdescribed above. For example, when the user is performing the editingoperation for longer than a predetermined time using the recordconfirmation screen 400, the imaging device may shift to the editingmode for editing the video image. This editing mode means the dedicatedfunction for the editing during the replay mode.

As described above, according to the embodiment of the presentinvention, when the display time of the record confirmation screen 400reaches the predetermined time Ts2, the imaging device 10non-temporarily records the video image and the index information, andautomatically deletes the record confirmation screen 400. As anotherexample, the record confirmation screen 400 may be provided thereon witha GUI button for completing the display of the record confirmationscreen 400. When the user designates (taps) the GUI button, the imagingdevice 10 may record the video image and the index information in therecording medium, delete the record confirmation screen 400, and returnto the record wait state.

2. SECOND EMBODIMENT

Next, a second embodiment of the present invention will be described.The imaging device 10 according to the second embodiment sets thesection, in which an object designated by the user on the live-viewscreen 300 while the video image is captured appears, as the indexsection. The second embodiment is different from the first embodiment inthe setting method of the index section, and the other functionalconfigurations are substantially the same as those in the firstembodiment, thereby omitting the detailed description thereof.

[Setting of Index Section by Object Recognition]

First, with reference to FIG. 12, the description will be made of thesetting method of the index section using the object recognitionaccording to the second embodiment of the invention. FIG. 12 is adiagram illustrating the display example at the time of setting theindex section by designating an object 340 in the captured image 302 onthe live-view screen 300 according to the second embodiment of theinvention.

As shown in FIG. 12, the captured image 302 of the object being imagedby the imaging device 10 is displayed in real time on the live-viewscreen 300 while the video image is captured. The object 340 (a dog inthe example shown in FIG. 12) which the user wants to image is in thecaptured image 302 on the live-view screen 300. The object is anarbitrary thing as a target to be imaged by the imaging device 10, suchas a person, a face of a person, an animal, a plant, a vehicle, abuilding, a landscape, or the like.

When the user designates (taps) the object 340 in the captured image 302with its finger while the video image is captured, the imaging device 10recognizes the object 340 in the position on the live-view screen 300,which is designated by the user. Then, the imaging device 10 sets thesection, in which the object 340 appears, in the video image capturedduring the recording time period as the index section. Hereinafter, thedescription will be made of the operation at the time of setting theindex section using the object recognition in this manner.

First, the user designates the object 340 displayed on the live-viewscreen 300 using the operating body while checking the live-view screen300 while the video image is captured. The user's operation ofdesignating the object 340 corresponds to the operation of inputting theinstruction for the index with respect to the imaging device 10. Thetouch panel 40 detects the position, which was designated by the user,on the live-view screen 300 in response to the designation of the object340 with respect to the live-view screen 300. Then, the imaging device10 analyzes the frame of the captured image 302 at the time point,thereby recognizes the object 340 in the screen position designated bythe touch panel 40. Subsequently, the object recognition unit 240specifies a plurality of frames, in which the object 340 appears, fromthe video image captured during the recording time period. Then, theimaging device 10 sets the section of the video image, which isconstituted by the plurality of the frames in which the object 340appears, as the index section. This index section covers before andafter the time point of user's inputting of the instruction for theindex (the time point at which the object 340 was tapped) as long as theobject 340 appears in the section. That is, the index section includesboth the section which was already captured before the time point ofinputting the instruction for the index (the part corresponding to theindex section object 320 in FIG. 12) and the section which is capturedafter the time point of inputting the instruction (not shown in FIG.12).

When the index section is set by the object recognition, the imagingdevice 10 displays the index image regarding the set index section onthe live-view screen 300 for the predetermined time Ts1 as shown in FIG.12. This index image includes an object model 345 in addition to thetime bar 310, the index section object 320, and the thumbnail image 330which are described above. The object model 345 is a display model whichis obtained by making the recognized object 340 animated. The user canconfirm the position and the time length of the index section in whichthe designated object 340 appears by checking such an index image. Inaddition, it is possible to confirm the recognized object 340 by theobject model 345.

As described above, the imaging device 10 according to the embodiment ofthe invention uses the object recognition, automatically picks up onlythe section in which the object 340 designated by the user appears, andsets the index section. With this configuration, the user can add theindex to the section of the video image in which the desirable object340 appears only by a simple operation of designating the object 340 onthe live-view screen 300. Accordingly, it is easy to distinguish thesection in which the desirable object 340 appears and the other sectionsin replaying and editing the video image after imaging. In addition, theuser can replay only the section in which the object 340 appears, ordelete the other sections (that is, the sections in which the object 340does not appear). Moreover, since it is possible to input theinstruction for the index by the user's operation on an arbitraryposition on the touch panel 40, it is not necessary to provide thededicated operating unit for the index (the index button 30F, or theindex icon 306) as in the first embodiment.

[Deletion of Sections in which Object does not Appear]

Next, with reference to FIG. 13, the description will be made of themethod for deleting a part of the video image on the record confirmationscreen 400 using the deletion icon 450C after imaging. FIG. 13 is adiagram illustrating the display example at the time of deleting thesections other than the index section in the record confirmation screen400 according to the embodiment of the invention.

As shown in FIG. 13, the above-mentioned functional icons 450 aredisplayed on the record confirmation screen 400 which is displayed afterthe completion of the recording. The deletion icon 450C among thesefunctional icons is an operating button for deleting the sections otherthan the index section in the recorded video image all together. Whenthe user designates (taps) the deletion icon 450C while the recordconfirmation screen 400 is displayed, the imaging device 10 deletes theimage data of the sections other than the index section in thetemporarily recorded video image, and non-temporarily records the imagedata of only the index section in the recording medium 2.

Specifically, in the example shown in FIG. 13, the index section is set,by the object designation described with reference to FIG. 12, while thevideo image is captured, and the sections in which the object 340 doesnot appear are deleted in the record confirmation screen 400 displayedafter the completion of the recording of the video image. As shown inFIG. 13, two index section objects 420A and 420B are displayed on therecord confirmation screen 400. It can be seen from this display thatthe two index sections were set while the video image was being capturedand the object 340 (for example, a dog) designated by the user while thevideo image was being captured appears in the respective index sections.

When the user taps the deletion icon 450C in the record confirmationscreen 400, the imaging device 10 specifies the index section in whichthe object 340 appears and the other sections based on the indexinformation recorded in the memory 238 while the video image was beingcaptured. Then, the imaging device 10 deletes the sections in which theobject 340 does not appear (corresponding to the shaded area 414 in thetime bar 410 shown in FIG. 13) in the temporarily recorded video image,and non-temporarily records the section in which the object 340 appears(corresponding to the index section object 420 in FIG. 13) in therecording medium 2.

As described above, the imaging device 10 deletes the unnecessarysections, in which the object 340 designated by the user while the videoimage is captured does not appear, in response to the user's simpleoperation of tapping the deletion icon 450C, and records only thenecessary sections in which the object 340 appears. Accordingly, theuser can pick up and record only the image section in which thedesirable object appears only by designating the object 340 in thelive-view screen 300 shown in FIG. 12 while the video image is capturedand then designating the deletion icon 450C in the record confirmationscreen 400 shown in FIG. 13. Therefore, it is possible to efficientlyexecute the editing operation for the video image in a short time.

[Auto-Deletion of the Section in which Object does not Appear]

Next, with reference to FIG. 14, the description will be made of themethod for automatically deleting a part of the video image in thelive-view screen 300 while the video image is captured. FIG. 14 is adiagram illustrating the display example at the time of automaticallydeleting the section captured before the index section, in the live-viewscreen 300 according to this embodiment of the invention.

As shown in FIG. 14, when the user designates (taps) the object 340displayed on the live-view screen 300 while the video image is captured,the imaging device 10 sets the section in which the object 340 appearsas the index section by the object recognition in the same manner as inFIG. 12. Moreover, the imaging device 10 automatically deletes thesection of the video image captured before the index section inaccordance with the setting of the index section which is accompaniedwith the designation of the object 340. Here, the section of the videoimage captured before the index section means the section from thebeginning of the video image being captured to the start point of theset index section (corresponding to the shaded area 314 in the time bar310 shown in FIG. 14).

As described above, the imaging device 10 automatically deletes thesection before the index section in the video image which was alreadyimaged and recorded, at the time point at which the index section is setby the object recognition while the video image is captured. As aresult, the image device 10 can automatically deletes the unnecessarysection captured before the index section even if the user does notperform the deletion operation while the video image is captured.

Such an auto-deletion is useful in the following use case, for example.A case is assumed in which the user gets ready for imaging a movingthing A (for example, a running child in an athletic festival, atraveling train, and the like) with the imaging device 10 which is beingoperated for the recording, for example. In this case, when the movingthing A enters the imaging range of the imaging device 10, the user tapsthe thing A appearing in the live-view screen 300. Then, the imagingdevice 10 sets the section in which the thing A appears as the indexsection, and automatically deletes the data of the part which wascaptured before the thing A appears. With these operations, the imagingdevice 10 can record only the image data of the section in which thedesirable thing A appears, in the recording medium.

In the examples of FIGS. 12 to 14, the description was made of theexamples in which a dog was exemplified as the object 340 and thesection in which the dog appeared was set as the index section. However,the embodiment of the present invention is not limited to the example.For example, a face of a person may be designated as the object 340, andthe section in which the face of the person appears may be set as theindex section. In addition, it is also possible to combine the objectrecognition technique and the smile detection technique and set thesection in which the person's smile appears as the index section.

3. THIRD EMBODIMENT

Next, a third embodiment of the present invention will be described. Theimaging device 10 according to the third embodiment of the inventionsets the index section in response to the user's gesture (the method ofsliding on the display screen) with respect to the touch panel 40, whilethe video image is captured. In addition, the third embodiment isdifferent from the first and the second embodiments in the settingmethod of the index section, and the other functional configurations aresubstantially the same as those in the first and second embodiments,thereby omitting the detailed description.

As described above, the touch panel 40 can detects not only the positionon the display screen, which is designated by the operating body (forexample, a user's finger), but also the method how the operating bodyslides on the display screen (for example, the sliding direction and thesliding length). Accordingly, when the user's operating body slides onthe display screen while the video image is captured, the imaging device10 can detect the sliding method using the touch panel 40, and changethe setting method of the index part in accordance with the slidingmethod.

For example, the imaging device 10 sets the index section while usingthe time point at which the operating body slides on the display screenas a reference in accordance with the sliding direction of the operatingbody on the display screen. In addition, the imaging device 10 sets thetime length and the start point of the index section in accordance withthe sliding length of the operating body on the display screen. In thismanner, it is possible to increase the variations of the index sectionwhich can be set by the imaging device 10 in response to one user'soperation on the display screen, by setting the index section inaccordance with the sliding method on the display screen by the user.Accordingly, the user can instructs the imaging device 10 to set thedesirable index section with a simple operation. Hereinafter, a specificdisplay example will be described.

[Setting of Index Section in Accordance with Sliding Direction onScreen]

First, with reference to FIGS. 15 and 17, the description will be madeof the method of setting the index section in accordance with thesliding direction on the display screen in the live-view screen 300according to the third embodiment of the invention. FIG. 15 shows adisplay example when the operating body slides on the object 340 in theleft direction on the live-view screen 300, and FIG. 16 shows a displayexample when the operating body slides on the object 340 in the rightdirection on the live-view screen 300. FIG. 17 shows a display exampleof the record confirmation screen 400 displaying the index part set inFIG. 16.

As shown in FIG. 15, when the user's finger slid on the object 340included in the captured image 302 on the live-view screen 300 in theleft direction while the video image was being captured, first of all,the imaging device 10 detects the position on the live-view screen 300,on which the finger slid, and the sliding direction using the touchpanel 40. Then, the imaging device 10 recognizes the object 340 whichappears in the position on the live-view screen 300, on which the fingerslid. In this case, the user's operation of sliding on the displayscreen (the touch panel 40) corresponds to the operation of inputtingthe instruction for the index, and the time point at which the fingerslides on the display screen corresponds to the time point of inputtingthe instruction for the index. In addition, the processing forrecognizing the object 340 is the same as that in the second embodiment.

Next, the imaging device 10 sets, as the index section, the section fromthe start point (corresponding to the point 324) of the section in whichthe object 340 appears to the time point at which the finger slides onthe display screen (corresponding to the point 322) in the video imagewhich was already captured before the time point at which the fingerslides on the display screen. Here, the start point of the section inwhich the object 340 appears corresponds to the frame in which theobject 340 is recognized in the video image for the first time.Thereafter, the imaging device 10 displays the index display such as theindex section object 420 which represents the set index section, on thelive-view screen 300.

As described above, when the finger slides on the object 340 in the leftdirection on the live-view screen 300, the section, in which the object340 appears, in the video image captured before the time point at whichthe finger slides on the object 340 (that is, the time point ofinputting the instruction for the index) is set as the index section.For example, when the user thinks that it is the time to complete theimaging of the object 340 while the desirable object 340 is imaged, theabove setting method is useful for the case in which the video image iscaptured a little longer just in case.

On the other hand, as shown in FIG. 16, when the user's finger slide onthe object 340 included in the captured image 302 on the live-viewscreen 300 in the right direction while the video image is captured, theimaging device 10 detects the position on the live-view screen 300, onwhich the finger slid, and the sliding direction by the touch panel 40,and recognizes the object 340 which appears in the position on which thefinger slid. Then, the imaging device 10 sets as the index section, thesection from the time point at which the finger slid on the displayscreen (corresponding to the point 322) to the last point of the sectionin which the object 340 appears (corresponding to the point 326) in thevideo image captured after the time point at which the finger slid onthe display screen. Here, the last point of the section in which theobject 340 appears corresponds to the frame in which the object 340recognized in the video image for the last time.

In the example shown in FIG. 16, since the last point of the indexsection (corresponding to the point 326) is unknown at the time point atwhich the finger slides on the object 340 in the right direction, theimaging device 10 sets only the start point of the index section(corresponding to the point 322). In addition, the imaging device 10displays only the point 322 representing the start point of the indexsection object 420 on the live-view screen 300, and then extends anddisplays the index section object 420 on the right side with the passageof the imaging time. Thereafter, when the object 340 moves out from theimaging range and does not appear in the captured image 308, the imagingdevice 10 sets the last point of the index section (corresponding to thepoint 326), and displays the index section object 420 representing thewhole index section which has been fixed.

As described above, when the index section is set by the finger'ssliding on the object 340 in the right direction on the live-view screen300 shown in FIG. 16, it is possible to confirm the final index sectionon the record confirmation screen 400 shown in FIG. 17, which isdisplayed after the completion of the recording. In the live-view screen300 shown in FIG. 17, the index section object 420 representing theindex section set by the sliding operation in the right direction. Thepoint 422 at the left end of the index section object 420 represents thestart point of the index section (the time point of inputting theinstruction for the index), and the point 426 at the right endrepresents the last point of the index section.

As described above, when the finger slides on the object 340 in theright direction on the live-view screen 300, the section, in which theobject 340 appears, in the video image captured after the time point atwhich the finger slides on the object (the time point of inputting theinstruction for the index) is set as the index section. This settingmethod is useful for the case in which the user wants to image entirelythe object 340 in the rest part after the time point at which theexciting scene of the object 340 appears while the desirable object 340is imaged.

[Setting of Index Section in Accordance with Sliding Length on Screen]

Next, with reference to FIGS. 18 and 19, the description will be made ofthe method for setting the index section in accordance with the slidinglength on the display image in the live-view screen 300 according to thethird embodiment of the invention. FIG. 18 is a display example when thefinger slides on the object 340 on the live-view screen 300. FIG. 19 isa diagram illustrating the relationship between the sliding length andthe time length of an added section.

As shown in FIG. 19, when the user's finger slides on the object 340included in the captured image 302 on the live-view screen 300 in anarbitrary direction (the right direction in FIG. 19) while the videoimage is captured, the imaging device 10 first detects the slidingposition and the sliding direction on the live-view screen 300 by thetouch panel 40. Then the imaging device 10 recognizes the object 340which appears in the position, on which the finger slid, on thelive-view screen 300.

Then the imaging device 10 sets the time length of the added section(corresponding to the checked part 316 in the time bar 310 shown in FIG.18) in accordance with the sliding length. As shown in FIG. 19, theimaging device 10 sets the time length of the added section such thatthe longer the sliding length on the display screen by the user is, thelonger the time length of the added section is.

Here, the added section is a section captured for a predetermined timebefore the time point of inputting the instruction for the index (thetime point at which the finger slides on the display screen), andincluded in the index section. This added section is constituted by theimage captured a little before the time point of inputting theinstruction for the index. Therefore, there is a high possibility thatthe added section is a scene in which the desirable object 340 appearsor the introduction part of the exciting scene. It is possible to allowthese necessary scenes to be included in the index section by allowingthe added section to be included in the index section. Accordingly, itis possible to compensate the delay of the user's input of theinstruction for the index. However, the unnecessarily long added sectionis not appropriate since an unnecessary section is unfavorably includedin the index section.

Thus, the imaging device 10 sets the time length of the added section inaccordance with the sliding length by the user in order to adjust thetime length of the added section appropriately in response to the user'soperation (the gesture) on the live-view screen 300. As a result usercan set the time length of the added section to a desirable one bychanging the sliding length. For example, the user's finger may slide onthe display screen with a long sliding length when the user wants to setthe added section before inputting of the instruction for the index tobe longer, and the user's finger may slide on the display screen with ashort sliding length when the user wants to set the above-mentionedadded section to be shorter.

Next, the imaging device 10 sets the index section including the addedsection with a time length set in accordance with the sliding length.That is, the imaging device 10 decides the time length of the addedsection in accordance with the sliding length, and sets the section fromthe time point preceding the time point, at which the user's finger slidon the live-view screen 300 (corresponding to the point 322 shown inFIG. 18), by the time length as the start point of the index section.Then, the imaging device 10 sets the section of the video image capturedafter the start point as the index section. At this time, the addedsection is constituted by the frames captured in the time period fromthe time point at which the user's finger slid on the display screen tothe time point preceding it by the time length. Moreover, the imagingdevice 10 deletes the unnecessary section at the beginning of the videoimage preceding the added section (corresponding to the shaded part 314in the time bar 310 shown in FIG. 18).

As described above, when the user's finger taps and slides on the object340 on the live-view screen 300, the imaging device 10 allows the addedsection (316) preceding the time point of tapping the object 340 by thetime length in accordance with the sliding length, from among the videoimage already captured, to be included in the index section, and deletesthe unnecessary section (314) preceding the added section. As a result,it is possible to compensate the delay of user's inputting theinstruction for the index and allow the section necessary for the userto be appropriately included in the index section. This imaging device10 is useful particularly because the time length of the index sectionbefore the time point of sliding on the display screen (that is, thetime length of the added section) can be freely adjusted in accordancewith the sliding length.

In addition, the sliding direction may be an arbitrary direction such asthe left direction in addition to the right direction shown in FIG. 18.Moreover, the time point as a reference of the added section may be thetime point at which the user's finger slides on the object 340 asdescribed above (that is, the time point of inputting the instructionfor the index), or may be the time point at which the object 340 isrecognized.

As described above, the imaging device 10 according to the embodiment ofthe invention can set the index section in accordance with the slidingmethod on the display screen by the user (the gesture with respect tothe touch panel 40). As a result, the user can designate the positionand the time length of the index section in accordance with the slidingmethod on the display screen, and set the desirable index section. Inaddition, the user can freely set the index section with a simpleoperation of changing the sliding method on the display screen, andperform the editing operation efficiently.

4. CONCLUSION

As described above, the detail description was made of the imagingdevice 10 and the image processing method according to the preferableembodiments of the present invention. According to the embodiments ofthe present invention, the user can add the index not to a time point inthe video image but to a section with an appropriate time length withone operation while the video image is captured. As a result, it is notnecessary for the user to perform multiple operations on the imagingdevice 10 in order to add the index to the desirable section in thevideo image. In addition, the user can add the index with a simpleoperation, and the imaging device 10 has a satisfactory operability.

Moreover, the user can freely adjust the start point or the last pointof the added index while checking the contents of the recording in therecord confirmation screen 400 displayed immediately after thecompletion of the recording of the video image. Accordingly, it ispossible to add an index with higher accuracy.

Furthermore, the imaging device 10 makes a correspondence relationshipbetween the set index section and the time axis of the video image, anddisplays the index section on the live-view screen 300 while the videoimage is captured or the live-view screen 300 immediately after therecording. As a result, it is possible to show the user the indexsection of the video image such that the user can easily view the indexsection, while the video image is captured or immediately after therecording while the user can still remember the contents clearly.Accordingly, the user can know the contents of the video image easilyand appropriately, and easily determine the necessity of adjusting theindex section or editing the video image.

As described above, it is possible to add the index to the desirablesection such as the exciting scene in the video image with high accuracywhile the video image is captured and immediately after the completionof the recording while the person who images the video image canremember the contents clearly. Therefore, in replaying and editing thevideo image later, the user can perform the replaying and the editingoperations of the video image efficiently in a short time while usingthe index section as a guide.

In addition, it is possible to replay only the necessary part (the indexsection) in the captured video image automatically or by a user's simpleoperation on the live-view screen 300 or the record confirmation screen400, and delete the unnecessary part (the sections other than the indexsection). Accordingly, it is possible to handle the video image moreefficiently as compared with the imaging device in related art.Particularly, it is possible to perform the editing operation ofdeleting the unnecessary part in the recorded image automatically whilethe video image is captured or by a simple operation on the touch panel40 immediately after the recording. Therefore, it is possible to performthe editing operation much more efficiently.

In addition, since it is possible to record only the necessary part inthe captured video image in the recording medium while the video imageis captured or after the completion of the recording as described above,it is possible to efficiently perform the recording operation withoutwasting the recording medium.

Moreover, according to the second embodiment of the invention, theimaging device 10 with a configuration in which the object recognitionis employed for the setting of the index section can add the index tothe section of the video image, in which the desirable object 340appears, with a simple user's operation of designating the object 340 onthe live-view screen 300. Accordingly, the user can easily distinguishthe section in which the desirable object 340 appears and other sectionsin replaying or editing the video image after imaging.

Furthermore, according to the third embodiment of the invention, it ispossible to detect the user's sliding method on the live-view screen 300(the gesture) using the touch panel 40, and set the index sections ofvarious variations in accordance with the sliding method. As a result,the user can freely add the index to the desirable section with a simpleoperation.

The present application contains subject matter related to thatdisclosed in Japanese Priority Patent Application JP 2009-162839 filedin the Japan Patent Office on Jul. 9, 2009, the entire content of whichis hereby incorporated by reference.

It should be understood by those skilled in the art that variousmodifications, combinations, sub-combinations and alterations may occurdepending on design requirements and other factors insofar as they arewithin the scope of the appended claims or the equivalents thereof.

1. An imaging device comprising: a display unit for displaying a videoimage being captured; an index operating unit for inputting aninstruction for an index; and an index setting unit for setting as anindex section, a section in the video image captured for a predeterminedtime period including a time point of a user's operation of inputtingthe instruction for the index, in response to one user's operation onthe index operating unit while the video image is captured.
 2. Theimaging device according to claim 1, wherein the index operating unitincludes a position detecting unit for detecting a position in a displayscreen of the display unit, which an operating body touched orapproached; and wherein the user's operation includes allowing theoperating body to touch or approach the display screen.
 3. The imagingdevice according to claim 2, further comprising: an object recognitionunit for recognizing an object which appears in the video image, whereinthe position detecting unit detects a position on the display screen,which was designated by the operating body while the video image wasbeing captured, wherein the object recognition unit recognizes theobject which appears in the position on the display screen, which wasdesignated by the operating body, and wherein the index setting unitsets as the index section, the section in the video image, in which theobject recognized by the object recognition unit appears.
 4. The imagingdevice according to claim 3, further comprising: a deletion unit fordeleting a section in the video image which is captured before the indexsection, when the section in the video image in which the object appearsis set as the index section while the video image is captured.
 5. Theimaging device according to claim 2, wherein the position detecting unitdetects a sliding method on the display screen by the operating bodywhen the operating body slides on the display screen while the videoimage is captured, and wherein the index setting unit sets the indexsection in accordance with the sliding method.
 6. The imaging deviceaccording to claim 5, wherein the position detecting unit detects thesliding direction of the operating body, and wherein the index settingunit sets the index section in accordance with the sliding directionwhile using the time point at which the operating body slides on thedisplay screen as a reference.
 7. The imaging device according to claim5, wherein the position detecting unit detects the sliding length of theoperating body, and wherein the index setting unit sets the indexsection which employs as the start point, the time point preceding thetime point at which the operating body slides on the display screen bythe time decided in accordance with the sliding length.
 8. The imagingdevice according to claim 2, further comprising: a recording unit forassociating index information representing the index section with thevideo image and recording the associated index information in arecording medium; and a display control unit for causing the displayunit to display a record confirmation screen of the video imageimmediately after the instruction for the completion of the recording ofthe video image, making a correspondence relationship between a displayobject representing the index section and a time axis representing therecording time of the video image based on the index information, anddisplaying the display object on the record confirmation screen, whereinthe position detecting unit detects a user's operation on the displayobject representing the index section displayed on the recordconfirmation screen, and wherein the index setting unit adjusts theindex section in response to the user's operation.
 9. The imaging deviceaccording to claim 8, further comprising: a deletion unit for deletingthe sections other than the index section in the video image in responseto the user's operation on an icon displayed on the record confirmationscreen.
 10. The imaging device according to claim 1, further comprising:a display control unit for making a correspondence relationship betweenthe display object representing the index section and the time axisrepresenting the recording time of the video image and displaying thedisplay object on a live-view screen displayed on the display unit whilethe video image is captured.
 11. An image processing method comprisingthe steps of: displaying a video image being captured on a display unitwhile capturing the video image; and setting as an index section, asection in the video image captured in a predetermined time periodincluding the time point of a user's operation of inputting aninstruction for an index, in response to one user's operation on anindex operating unit for inputting the instruction for the index whilethe video image is captured.
 12. A program for causing a computer toexecute the steps of: displaying a video image being captured on adisplay unit while capturing the video image; and setting as an indexsection, a section in the video image captured in a predetermined timeperiod including the time point of a user's operation of inputting aninstruction for an index, in response to one user's operation on anindex operating unit for inputting the instruction for the index whilethe video image is captured.